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ABSTRACT 

This guidelx>ok explains how to conduct a telephone 
survey that will gather the information necessary for new program 
needs assessment in the Wisconsin Vocational, Technical, and Adult 
Education system. The guidebook is l>ased on pilot assessments 
conducted toy Fox Valley Technical College. The guidetoook contains 
five sections* (i) intrt^uction — ^why do the survey by telephone; (2) 
getting ready for the telephone survey — list of employers, 
determining how many to interview, and alerting ea^Jlc^ers before the 
survey; (3) sections in the sanple questionnaire; (4) telephone 
interviewing—basic procedures, selecting interviewers, training and 
supervising interviewers, and facilities for interviewing; and (5) 
results of two pilot tests— list of employers, response rate, the 
mail option method, interviewing time, and costs. Four appendices 
contain samples of an introductory letter, questionnaire, cover 
letter for mail option, and call record form. (NLA) 
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Introduction 



Technicai colleges in Wisconsin must survey local bu^ness and im^ry ^ part of their 
effotts to establish new occupational pix^rams. Tre^on^iy. this survey has been 
conducted by mail. However, another option for surveying businesses exists-the 
telep}K)ne sun<ey. This guidebook presents the "nuts and boHs** of how to conduct a 
telephone survey that will gather the information necessary for new program needs 
assessment in the Vocational, Technical and Adult Education (VTAE) system. The 
guidebook offers suggestions to technk^i colleges who may want to conduct surveys by 
telephone. It does not intend to mandate a telephone methodok>gy. The procures and 
sample questionnaire in this guktobook are based on the expnarience of Fox Valley 
Technk^al College in doing two pilot needs assessments by telephone and from the 
experience of several other technical schools who, during the Fall of 19^, kincfiy sharad 
infonnation about their practices in telephone survey research with us. 

Why Do the Survey By Telephone? 

Telephone surveys offer several advantages over the mail survey. Among these 
advantages are: 

o Telephone interviewing is faster. Speed is probably the major advantage. A 
typk^al telephone survey can be completed in two weeks or less, while many mail 
Sundays may drag on for months. 

0 Telephone Interviewing yields a higher response rate. While many VTAE 
program E^sessnients by mall will obtain response rates in the 40-50% range, a 
telephone survey wilt get response rates in the range of 70-80% of employers 
called. It is rare for a kscal business to refuse an interviewer calling from the 
technicai college, it is much easier to ignore a mail^ sun^ey. 

o "^^lephone intmiewing is more friendly. Some businesspeople woukl actually 
prefer to be surveyed by telephone rather than by an impersonal, written survey 
form. Many like the two-way exchange, if caught at an inconvenient time, they 
can simply ask the interviewer to call again at a t>etter time. 

o Telephone interviewing engages the appropriate respondent. With a mail 
survey, you're never sure who is completing the survey, even when you specify 
who should respond. With a telephone survey, the respondent can be asked if 
he/she is the person who hires and supervises the occupation being researched. 
If not, the inten^iewer can ask to speak to that person. 

0 Telephone interviewing aSlows probing and clarifying questions. With a mail 
survoy, there is no chance for the respondent to ask what you are really looking 
for in a question. There is no chance tor the interviewer to ask the respondent to 

1 



ERIC 



e 



darify his/her answer. The telephone survey minimizes misunderstandings that 
even the most carefuliy-worded mail survey c^estions sometimes cannot avoid. 

0 Teieptione hitmlewing ^Iminates skipped items. Respondents in a mail 
survey will frequently ^p open-ended Items or Items that they do not know how 
to answer. On the telephone, the interviewer can eliminate skipped Items almost 
altogether. 

0 A telephone survey tiiminates typesetting the questionnaire. Most well- 
conducted mail surveys use an attractively iak:l out and typeset (or desktop 
published) questtonnaire since this is known to enhance the response rate. With 
a telephone sun^ey. the respondent never sees the c^estionnaire, so the time and 
expense of typesetting is eliminated. A telephone qu^tionnaire can be formatted 
for iasx, easy data entry and inten^ewer use without concern about the print 
quality. 

0 Telephone interviewing allows Mter survey pool management inevitably, the 
list of potential employers will contain some that are inappropriate for the sun^ey, 
for example, those employers out of business, one-person firms with no 
employees, those who do not intend to hire the occupation being researched, and 
those who are in business with another employer on the list, instead of spending 
time re-mailing surveys to inappropriate t^sinesses. the interviewer can determine 
whether the business should be removed from the poo! in the first call. A mail 
survey will likely count inappropriate employers as non-respondents since they 
frequently do not return their surveys. This decreases the response rate and the 
credibiiity of the mail survey. 

Of course, there are some drawbacks to 
telephone survey. The respondent has 
no opportunity to look up data or consult 
with others in the company about certain 
answers. Another drawback is that the 
method requires trainmi interviewers. 
Perhaps the biggest perceived drawback 
of a telephone survey is the cost. 
However, we have found that the cost is 
not much more than a mail sun^ey, If it is 
conducted "in-house." (See section on costs.) 

In sum, the telephone survey is a viable option for VTAE districts conducting research on 
labor market demand for new programs. The mail survey is stiil a viable option, one 
which many technical college are comfortable with and will continue to successfully use. 
However, colleges who want to use an alternative method will find the prxjcedures and 
sample questionnaire in this guidebook useful. 
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Getting Ready for the Telephone Survey 



List of Employors 

Compiling a list of empkiyers to be surveyed is no different for a telephone survey than 
for a mail survey. However.itis not so c^itic^ ttiat inappropriate employers be kept off 
the teief^ne list because of the ability In a telephone survey to screen out inappn^Kiate 
respondents from the survey pool. When constnicting a list for a telephone survey. If 
there is any chance that the emptoyer would be an apprD|»late respondent, add that 
employer to the list. The telephone mettwi will screen that employer out if they are 
inappropriate. 

For example, if you are using a list of professional ^sedation members such as dentists, 
attorneys, etc., it may not be possible to know whteh ir^iduals are aduaily part of a 
single firm. Or it may m« be possit^e to detemiine whteh finms are actually branches of 
a larger firm, where the hiring is done. Th^ (^plicate cases will usually become 
apparent with the first telephone call to such emjrfoyere, enabling the telephone 
Interviewer to remove c&jplteate employing units from the sun^ey pool. Of course, with 
any survey it is desirable to start out with as "^ean" a list as possible. 

A "Position Paper on the methoctology for occupational program needs analysis was 
published by Doug Heit of the Chippewa V^ey Technical College a few years ago which 
Wentified several sources for compiling a list of potential emfrioyere for the needs 
assessment. Sources from whteh potential employers may be drawn are: 

o DILHR unemployment compensation printouts; 
o Ucensing bureaus; 

0 Memberehip lists of professional assodations; 
0 Membership lists of occupational associations; 
o Internal business/industry i^ntact systems; 
o Wisconsin Classified Directory of Manu^cturers; 
o Telephone directories; and 
0 Suggestions from advisory members & Instructors. 

In addition, a mainframe computer tape, the ES202 tape, may be purchased from DILHR. 
Employers are indexed by SIC code, by zip code, and by county. From the tape you can 
print out a list of mailing labels for a given InAjstry (defined by SIC code) tor a given 
geographical area (defined by zip code or county). 

Determining How Many Employers to interview 

It is best to begin a telephone survey with the target number you expect to complete. In 
a martlet research firm, this number might be detennined by a) what you coukJ afford to 
complete, or b) how many would yield a certain margin of error as shown In a table of 
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sample sizes requir«l various populations at the 95 percent confelence level. 
However, VIAE system personrwl generally expect to see a re^nse rate, l.e., ttie 
percent of the survey pool wHth whom you completed a questionnaire. Therefore, the 
following method for detemfilning how many to intendew is suggested wHth VTAE 
personnel in mind. 

Basically, we suggest continulr^ the intenrfewing urtil you reach at least 70 percent of 
your Sunday pod. So. if you hioJ a pool of 1<K) employers, you would want to intenfiew 
70 of them. If, as the survey progressed, you find that 20 of the employers are 
inappropriale for the survey, you would decrease the number of completed intewlews to 
70 percent of 80, or 56. While these are higher standards than the 40-50 percent 
response rate the State Board expecas for a mail suwey, and will cost more than if you 
stopped interviewing at 50 percent, our experience has shown that 70 percent of the pool 
can be inten^iewed without unraasonable actional time or cost. 

The key to Interviewing a reasonable number of employers is to begin with a manageable 
number in the survey pool. If you have 500 potential ennployers. rai^mly select 1 00 and 
let that sen^e as the survey pool. Do not attempt to telephone 70 percent of 5CK). It Isnl 
necessary, it's too costly and it's a waste of time and energy. » the original pool is less 
than 100. there is probably no need to pick a rarKtom sample, unless your interviewing 
resources will not allow you to comfrfete 70 interviews in a timely and cost-effective 
manner. In that caso, seled a smaller raiKtom sample and strive tor a 70 percent 
response rate (e.g., a randomly-selected pool of 50 with 35 completed interviews). 

Alerting Employers Before the Survey 



Should employers be notified before the ^^""^^""^""^ 

telephone survey that an interviewer may fifacfc^i^ TxinM C^i^ iSfMs 

be calling them? We used an introductory suceoss M^f t^^m0 Mmv^m 

letter to alert employers atxiut the wfmfi ttwy sent m MnxM^ Mm; 

impending telephone sun^ey and found m/PmcsMffmrnf^^i^ioi^Um 

that it did make a difference in the Mmm^ Tl^ hmm ^oiMHi 



interview completion rale. In one pilot 
sun^ey described in this guidebook, we thtmlo do'ao. 
mailed an introductory letter to one-half of ^^^^^^^^^^^^^^^^^^^ 
our sun/ey pool, while the other half ^^i^^^^^^"^^^^"^""""" 

received no introductory letter. At the end 

of the survey, we evaluated the response rates for the two groups and found that 85 
percent of the group who got the letter responded, compared to 76 percent of the group 
who received no letter. The response rate of the group who received no advance 
notification was still very high, suggesting that the letter is not necessary to achieve a 
high response rate. But since the introductory letter led to a significantly better resj»nse 
among the group that received it, our telephone survey practices now include written 
employer notification. 
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Fufthermore, thdrB are other 
reasons to iH}tify en^yers. 
For one thing, it lends a 
professional, frient^ approach 
to the «jn^. En^yers are 
e)9>ecting the call and wUi be 
better prepared for the 
interview. The IntRXfcjclory 
letter is good public relations, 
and enhances the survey's 
importance In the respomtont*s 
mind. In our pilot neecfes 
assessment, several 
re^ndents actually c^led the 
Research Office in order to 
compete the interview before 
going on vacation or to be sure 
they wouldn't miss out on the 
sun^ey. Some employers who 
are Interested in the new 

pr^ram may take that level of Initiative, which savmj having to call them badt or catchinn 

^•vedZ S^^^SLl^^*!!!* wamier reception from respondents who had 
1 J '"^"^^on^ 'etto*^- A postcard couki also be used with a shortened version 
of the letter. See Appendix A for a sample introductory letter. version 

However, what if the person corKJucting the sun<ey sees the Introductorv letter as t«o 
oTa" S oT^^7 'IT Lr?^ ^'"^ orer mSi^elTse'^j^ 

^"ws^e^ar^^^^^^^^^^ - r^nTorSr.^ 
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The Questionnaire 



Sections In the Sample QuestlcMmaIre 

useful m assessing employer reaction to the proposed program. Hoover, they are not 
at)solutely nec^sary to the survey. 

The samfrfe questionnaire has the following sections: 

screenina Section. The questionnaire contains a screening section In which the 

vor^h «S r^^ heShe is indeed the appropriate parly foMhe 

sS^^y T^e^rS section also requests participation the sur^^^^ ar^^ 
the inten^iewer to r^edule respondents for a more convenient time If ^ef?ssan^ 
IMhrc^S^^^^^ emploVthe occupation being researched and has no 
iant t?Sn thfcompany eliminated from the survey by Question 2a 

oufistlons About Employer Needs. The employer's cun-ent situation and futtjre 
?e^S??heo^ Theybeginthelntenriew 
Sy^swLring^ons that they, for the most part know the a*^*^ Jf • 
S4ge question?^ some employers are hesitant about ^l^^^.^'lJ^^^l 
Imo the interviiw after they are "wamied up" and have established some rapport 

with the interviewer. ^hmmmi^^^m^^'om""^^"' 

o Reaction to the Program. fMhBsm Wbami^ TeOu^sfCM^ 

r^tdway through the inleNiew, the tm toumi M wslksw^ucltt* s»i|W 

Interviewer reads a short "concept (pmmms ^ ^'^f^*^ 

statement- describing the program a^momsm^s^ '^^Z^Ht^ 

the college is proixjslng to develop. (^^n-mnMmse^km am ^^^f' »« 

The program description fits better ui(0 mom tmandm sss^ to m 

here than in the beginning of the imMmn^a hH^f^^^^on 

sun^ey. The beginning of the ^^^^^^^^^^^^mmmm^^m 
inten/iew can immediately engage 

respondents in answering some Thuc tha 
nuaSions rather than asking them to listen to a program description Thus, the 

questions about whether the employer would hire graduates, etc. 

o Demoaraphlcs. Few demographics are collected In the telephone survey since 

breakdowns aie'equired. The survey includes employer size, which 
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we have found useful but is not required. Interviewers also code whether the 
company tocaM within or mit of the €^.ct, if the sunrey inckides both, and 
they asl( for the name and position title of the re^ndent In the tnindreds of 
telephone intervieiK^ we have done, no one has ever refused to give this 
information. 



Flow of 

the Questionnaire 



Employer 
Demographics 



Reaction to 
Proposed Program 



End 



Screening 
Questions 



Present & Future 
Need for Occupation 




Beginning of Interview 
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Telephone interviewing 



Basic Proc€<iiires 

The procedure that worked besX In the pilot tests conducted / Fox Valley Technical 
College could i» desolbed as a basic telephone survey with a mail out option. 
Interviewers made an attem{^ to complete the survey by telephone and, In f^. the 
majority of surveys were completed by 
telephone. However, if it became dear 
that a) the resporuient was hardly ever 
available, b) the respondent prefened to 
complete the survey by mail, or c) the 
respondent's secretary suggested mailii^ 
the survey, the survey was mailed to the 
respondent with a cover letter. (See 
Aji^ndlx C for a sam^e letter that could 
to used to accompany the survey If 
mailed.} We have found it easier to ada(^ 
a telephone sun^ey for mail than to adapt a mail survey for telephone interviewing. And 
neariy all of the respondents who requested mailed surveys returned them. 

Training and supervising interviewers is key to conducing a successful telephone survey. 
A training session, usually corxjucted by the research person in charge of the needs 
assessment, shouki offer inten/iewers an explanation of the purpose of the survey, a 
com^riete review of the questionnaire, a set of call record-keeping procedures, and a 
chance to practk^e the interview. Training takes only a few hours, yet will prevent 
problems and increase interviewers' comfort with procedures. Training is a wise 
investment that will considerably enhance the quality of interviewing. 

After interviewer training is completed, the first step In the telephone interviewing is to 
start at the top of the list and call the first employer. If the appropriate respondent is not 
available, the interviewer shouki note by the name when to call b^ In no case shoukJ 
interviewere leave their number for a respondent to call back. The interviewer may be 
on another call when the respondent calls back; the respondent may never call back; or 
the respondent may not be pleased to retum a c^l that turns out to be a telephone 
survey. In short, asking ffia respondent to retum your call Is considered a poor 
market research fM^ce. However, if the respondent is available, the interview can 
usually be completed immediately. If the company is inappropriate for the survey or out 
of business, the Interviewer would remove the company from the survey pod. 



MMson Area tactuie^ ik^ego 
pwdkim M the mphimmM ^m 
mtfaomnekiamas^f^pf^iidv. They 
ma indln^ mm and mm Uma 
Isitmmmittmmiorpmson'io-pemn 
cMs^ mm m buski^ae and 
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Calling Procedure for Telephone Survey 




Interviewers note the results of each call, whether it ended in a completed interview or 
not, on a Call Record Fonn. See Appendix D for a sample Call Record Fomi on which 
the interviewers can keep track of the results of company cont^. We use a sat of 
codes to show the outcome of each call. 



Cod^ That Can Be Used 
To Record OiOocmms ofCaHs 



C 

Bern 

Ref 

CB 



Completed ifttmvfew 
Remove /Hsrn poof 

MaU out mjivey 



(See box on this page.) It is important 
that a written record of each contact be 
Kept because interviewers cannot be 
expected to remember the outcome of 
each call. The call record will remind 
them where to begin inten/iewing each 
day, show who needs to be called back at 
what time, and reveal who has not been 
contacted at all. Good records enable 
interviewers to exchange portions of the hh^^hh^^^^^^mmm^^h^h 
list without fear that they will call a 

respondent who complete the interview. At the end of the sun^ey, the Call Record Form 
will provide information needed for calculating the response rate. 

Interviewers contact employers every day until all nonresponding employers have been 
contacted at least three times. It may be necessary to contact them more than three 
times in order to complete the target number of interviews. Interviewers will usually know 
when they have exhausted a list of employers. 
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Setecting Intorviewers 

Telephone interviewers can come from several sources, in the pilot test at Fox Valley 
Technica! Ck)ilege, Marketing prc^ram students (or recent graduates} sensed as telephone 
interviewers. However, a Fall 1990 sun^ey of VTAE cKstricts revealed several other 
grouf^ of people who have done telephone interviewing: temporary help service 
employees, secretarial staff, community area coordinators, research staff, instructors, 
advisory committee members, and outside market research or telemarketing finns. Each 
group has Vantages and cSsadvantages: 

0 Temporary help service employees. These people are usually readily available 
and with mir^mal trainir^ can do the interviewing. If tfiey don't work out, you cm 
request someone else immediately. However, they can cost almost double what 
you woukil pay student employees. 

o Marketing students. Student employees from Marketing or other VTAE programs 
have been the best source of telephone interviewers at Fox Valley Technical 
College. They can be recruited directly from classes or they can be student 
intems "borrowed" from other offices. Interviewing is a valuable work experience 
for them. They are very cost elective. They will need training and supervision on 
the needs assessment project. 

0 Secretarial staff. A team of 2-4 secretaries could be trained to do the 
inten^iewing if they could be freed up from their other work for a few days. Some 
technical colleges have used secretaries. 

0 Research staff. The research staff at some technical colleges do the interviewing. 
This wori(s well in small surveys in which 25 or fewer intSA/iews must be 
completed and the respondent are easily reached. However, many research staff 
wouti be unable to free themselves up to do the interviewing for large scale 
surveys. 

0 Area coordinators. Area coordinators or community representatives can function 
as interviewers. Their contacts with business training directors may be helpful in 
securing a better response. Some area coordinators are not full-time employees 
and would have time for interviewing tasks. If they are based in outlying regions 
of the district, it may be diffk:ult to provide proper training and supen^lsion for the 
survey. 

0 Instructors. Some technical colleges have conducted surveys vinth instructors as 
inten^iewers. Instructors would know about the proposed new program and would 
be able to answer questions about it. A call from an instnjctor is usually good 
public relations. If they have the time and interest in interviewing, they could be 
an excellent resource. 
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0 Advisofyconuimtoeniembeis. Advisory committee members may be Interested 
In conducing the intenrtews. Some technical colleges have used them. The key 
is a small scale survey In which each j»fson gets a mana^sWe mimljer of 
IntenHews to complete. Advisory members may help the response rate by c^ir^ 
their business colleagues. However, using advisory manors as Interviewers 
could ca^ doubts on the "ob^ectiv.ty" of the survey, particularly if they are highly 
invested In wanting the survey to demonstrate a great need for the occupafion 
b€ ng researched. It would be difficult to supervise the Interviewing. 

0 Maifcet research or tetoma'keting firms. Interviewing can be contracted to 
outside cor^ulting firms who do market research or telemarketing. This 
arrangement has the advantages of providng trained intervleviwrs. suwey 
supervision, professionalism and speed. However, costs can mn from $1 4 to $35 
a completed interview, which is substantially more than the cost of doing a sun^ey 
"in-house." 

Training & Supervising Interviewers 

If intenriewers un<terstarKl the purpose of the sun^ey, purpose of each item, type of 
respor^nts they are attempting to reach, record-keeping procedures and have a chance 
to practice the interview, they vHII do a better job than if they had no training. The 
following training and supen^ision procedures were used at Fox Valley Tedink»l College 
in the pilot neecte ^^ssment where the interviewers were Marketing students. Three 
interviewers received the training In a group at a single two-hour session. Actual 
interviewing began the next day. 

Step 1- Explaiti the purpose of the survey. Explain what the college is trying to 
detennine and why this infomiatlon is needed. Knowing something about the proposed 
program and what (briefly) a technical collie does to start a new one helps to establish 
the importance of the suwey with interviewers. 

Step 2- fteview the questionnaire. Read the opening scri^ and explain the intent of 
each item on the suwey. Read each item with appropriate voice inflection the way you 
expect them to ask the questions of respondents. Exf^ain what type of answer you are 
looking for from respondents and how to record their answers. For open-ended items, 
intewiewers should write down what the respondent says word for word as best they can. 
Emphasize the importance of good handwriting and using a pendl so corrections can be 
made easily. 

Step 3- Arranqe practice sessions. Model the way an inten/iew should be conducted 
using one of the inten^iewers as a "respondent," or even a real respondent. Have the 
interviewers practice the intenriew on each other, on the trainer, on in-house respondents 
or on advisory members who have agreed to sen^e as test cases. Follow the prasllce 
interviews by resolving any questions inten^iewers may have about the questionnaire 
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items. Discuss various sHualions that ^^^■^■^■^^^^^^w^^^^^w 

may arise in interviewing. ^ tmmOm Aim TeGlu^ CoSe^ 

^ , ^ , . ^ . Mmi^mm Hmrwd to m mm^ 

SH^L-i-Explain call recowHseei^ng db^dc^ wm im cw^i^d H»m iM 
procedum. Explain how to take a few 
minutes following each completed 

intewiew to go over the res(K}nses to ^^^^iiM^^MMiMMiMMiMMMiMi. 

make sure all items are completed. 

Open-ended items, espedatly, can sometimes be made more legible or accurate in the 
minutes Immectiately fotiowir^ the intenriew. Explain the codes used to Indicate the 
outcome of each call on the Call Record Forni (See Appendix D) and the imfM^rtance of 
keeping accurate calling records. 

§t|IB>-R0view the first few comi^eted Intervleiivs with ttm Interviewers. After Step 
4 above, inten/iewers should be ready to begin making calls to actual respondents. 
Review the first few completed interview forms with each interviewer to make sure all 
responses have been property recorded and that there are no misunderstandings. 
Identify problems before a targe number of interviews are done, not after. Interviewers 
will be able to make adjustments if they know what you want Ask them how respondents 
are reacting to the qu^ions. Get their input and revise procedures or items accortfngly. 

SItpJ-Maintain dally contact witi intervievrars. Questions that no one has imagined 
will invariably arise so It is best to maintain daily contact with interviewers. Well-trained 
inten^iewers will bring problems to your attention. In our pilot survey, it became apparent 
that it made no sense to ask dentists how important certification was in their hiring of 
dental hygienists since certifk^ation is a requirement for the practice of dental hygiene. 
We were able to adjust this item before going further. Other problems can arise with lists 
of empfoyers, missing phone numbers, duplicate firms, etc. Once the sun^ey is 
underway, minimal nronitoring is usually all that's needed. 



Facilities for Interviewing 

The calling can be done from any reasonably private place with a phone. We 
recommend using secretarial stations only as a last resort. Places that technical colleges 
have used indude: 

0 Staff offices 

0 Conference rooms 

0 Conference roon^ with speaker phones 

0 Telephone labs (rows of telephones in can-els in a dassroom) 

We have not found It necessary to provWe telephone operator headsets. Our Interviewers 
have on occasion used speaker phones so that their hantte are free for recording 
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response. If telephone Inteivlewing progresses to computer-assisted interviewing, goo^- 
quality headsets would be n^ded. 

If interviewing is being done by advisory members, community reprmnmtives, or area 
representatives, they may complete the interviews from their work^ations or home. This 
arrangement is less desirable since the person responsible for the survey cannot observe 
the interviews or answer questions. 
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R^uits of TWO Pilot Tests 



In February 1991. we first tried out the pnx»(^res and questionnaire described in this 
guictobook in a needs assessment at Fox Valley Technlcai College. This paiticular 
assessment wee assessing the ne^ for dental hygienists so our inten^ievt^rs called 
dentsd offices in the district to detemiine employment potential. The neecte assessment 
was not strictly required by the YTAE System, but the survey was done because our own 
staff wanted the information. Nevertheless, we conchjcted the survey as if results would 
ultimately be used in a VTAE Program Proposal, Sections 7-8. 

In May 1991, we conduced a second pilot test in a neec^ assessment for a Materials 
Planning and Control Tedinidan program. This needs assessment was required by the 
VTAE System, and resulte were used in the VTAE Program Proposal, Sections 7-8. 

Our Ust of En^toyers 

For the Dental Hygienlst Sunrey, we used a mail list from the Wisconsin Dental 
Association, which was not a very "dean" list, it contained, for example, retired dentiste, 
dentists in group practices, dentists for whom we could find no telephone listings, and 
dentists whose practices h^ been taken over by other dentists. This list would have 
been more suited to surveying indrvklual dentists rather than dental "employing units,' 
who wouki be hiring our graduates. Nevertheless, in the first teleplKDne contact, our 
interviewers were able to identify inappropriate names and remove them from the sun^ey 
pool. The telephone methodology worked well to control the survey pool. 

One task that would not have been needed if a mail suivey h^ been done was looking 
up telephone numbers. The mail list did not come with phone numbers. A secretary 
spem several hours looking up phone numbers of 215 dentists in our distrxrt. Number 
look-up was completed before interviewing began. 

For the Materials Planning and Control Technician Survey, we compiled a list of 
respondents from names suggested by the ad hoc advisory committee. Each of 12 
members submitted ten names and phone numbers of appropriate respondents. After 
duplicate suggestbns were removed, we had a final survey pool of 81 respondents. TTiis 
method of generating an employer list yielded acoirate nam^ and phone numbers with 
only three inappropriate companies that interyieweis needed to remove fn^m the suivey 
pool after an initial call. 

Response Rate 

We ended the Dental Hygienist Survey with 81 percent cr dental offices completing 
interviews. As noted earlier, the response rate of dental offtcs s receiving the introductoiy 
letter was slightly higher (85 percent), compared to offk:es not receiving the letter. 
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Overall, a rasponse rate of 81 percent compares very favorably to what we could have 
expected In a mail survey. There Is reason to believe that even a ms^ survey of this 
particular group of employers would have been high, since they were extremely Interested 
m seeing a dental hygienlst program ^ed. Sii^e we (fid not survey half by mail and 
half by phone, we have no way to know how much (If at all) better a r^ponse rate was 
achieved with the telephone method. 

Fewer than five dentists In this survey refused to be Interviewed. The 1 9 percent who did 
not complete the inteiview were dentists who could not be reached after at least four calls 
to their office. There is no need to pursue respondents to the point of becomino a 
nuisance. ** 

A response rate of 72 percent was achieved in the Materials Planning and Control 
Technician Survey. Two employers refused to be Inteiviewed. At least three calls were 
made to nonrespondents. 

The Mall Option Method 

Mailing the questionnaire to employers who requested it from interviewers worked well 
m both surveys. About one- 
third of the dentists 
requested that the survey be 
mailed. We mailed the 
demist the questionnaire 
and cover letter in Appendix 
C. Only 32% of the mail 
outs were not sem back. 
This suggests that once 
employers requested the 
survey be sent, they 
committed to completing it. 
Our particular group of 
employers, i.e., demists who 
are frequemiy involved in 
demal procedures at the 
time they receive the call, 
may have requested the 
mall option more often than 
other employers who work 
near their phone. 

Twenty-two percent of rBspomtents in the Materials Planning and Control Technician 
Survey requ^ed or agreed to a mailout. These respondents, often Materials Managers 
who work near a phone, were readily accessible to imervlewers and somewhat less likely 



How the MaH OpUon Wbrted 
With Empk>yer8 in Telephone Survey 
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than dentists to request the m^l option. This group was also less likely than tlw dentists 
to return the mailed survey. Only 3 of 17 nwlled to returned their questionna^ 
Nevertheless, th^ adcStional 3 questionnaires Increased the overall response rale from 
68 to 70 percent. 

The questionnaires return^ by mail hal some skipped iten«, which is tyf^of a mailed 
survey. Otherwise. «Te telephone-formatted questionnaire worked fine with employers 
who prefen^ to send their response by mail 



Interviewing Time 



^^MiM^KBMKM^^HiiMMM the Dental Hygienist Survey, 
Ai Fax TaMad Od&Oft intendewing continued for nine working 

£Li^^ 7lrir^«S each emptoyer up to three times. Call 
SS'mSsJS^K bacte were m^e at «mes suggested 
m^^M Masemo^m Masm the dental offi<»s. 

^^Tl^iSS;^^ A total of 101 questionnaires (including 

'"all outs) were completed in this amount 

Hn^^^^MiB^H^aM^H^^MH adjusts! survey pool of 125.) I^ked at 

another way. interviewers completed 1.6 
surveys an hour. The inten^iews took approximately 10 minutes each to complete. 

In the l^aterials Planning and Control Technkaan Survey, interviewing took 45 ^ff hours 
over ten working days. Two inten/iewers called. A total of 58 questionnaires (Inducfing 
mailouts) were completed In this amount of time. Or, Inten^ievR^rs completed 1 .3 surveys 
an hour, slightly less than the rate in the Dental Hygienist Survey. 

Costs 

How expensive was it to conduct these telephone surveys with the mail option method? 
Our estimates reveal the cost per completed c^estionnaire in the Dental Hygienist Survey 
to be $3.12. This is based on student interviewers being paid $5 an hour with a total of 
83 hours of Inten/iewng time. Our total a>st to otrtain 101 completed surveys was 
$315.00. (Undoubtedly, the mail out option helped keep costs this low. Without mail out 
to about one-third of the respondents, o^ts would have been approximately $4.14 per 
questionnaire, or $418.00 to Inten/iew 101 employers on the telephone.) 

Costs for inten^iewing in the Materials Planning and Control Technteian Survey were 
$225.00, based on 45 hours of interviewing time at $5.00 an hour. With 58 completed 
surveys, we had a cost per survey of $3.88. 

16 
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Overall, doing the survey in-house student intervieweis ms far more cost effective 
than contracting the intervievvs with a market research or teiemarfcetlng firm. And the 
coste were not ^d>stantially moie than a mail survey. We believe the time savings and 
quality of infbnnatlon vvere well worth It. 
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Appendix A 
Sample IntrDductory Letter 



Date 



Dear (Name of Contact Person or Employer): 

(Name of) Technical College is launching a study to learn more aboiii the employment 
potential of (name of occupation). We are cor^ring developing a (Insert program 
length, e.g., tm-yeBr) program that wojld train student to (dsscr1l3e what the occupation 
does here briefly). In investigating the need forthis program, we are seeking the opinions 
of key employers In our region. 

You will be contacted shortly by telephone and asked to complete a brief Interview. Our 
Inten^iwwre will ask you about your future needs for (name of occupation). If necessaiy 
please feel free to ask them to reschedule the call at whatever time is convenient for you' 
We are hoping to speed up the Investigation process by conducting the research by 
telephone ir^ead of by mail. ' 

Thank you In advance for your participation in this survey. Meanwhile. If you have any 
questions about this project, (Name of Research Director) at (phone number) would be 
happy to answer them. / uuu« 

Sincerely, 



Director/President 




Appendix B 
Saiiple Questionnaire 



Note: Instructions to interviewers are capitalized. The actual 
script they read to respondents appears in lower case. 



Needs Assessnent Telephone Survey 

Hi, this is from Technical College. We're 

conducting a hrief survey on your company's need for (naaie of 
occupation), could I please speak to the person responsible for 
hiring or supervising (name of occupation)? 

IF THE COMPANY HAS NO EMPLOYEES IN THE OCCUPATION, TERMINATE 
INTERVIEW. 



A. 



Are you the person responsible for hiring or supervising 
(name of occupation) in your organization? 

Yes 1 CONTINUE 

No 2 ASK TO SPEAK TO PERSON RESPONSIBLE/ 

ARRANGE TIME FOR CALLBACK IF NECESSARY 



B. We re conducting a brief survey on your company's need for 
(name of occupation), whose duties would ordinarily include 
(brief description of duties). Would you have a few minutes 
to answer some questions about that occupation? 

Yes 1 CONTINUE 

No 2 RESCHEDULE INTERVIEW FOR ANOTHER TIME 



How many full~time (name of occupation) does your firm 
employ, defining full-time as 35 hours or more per week? 

Full-time (IF NONE, ENTER ZERO.) 

And how many part-tiffiQ, defining part-time as less than 35 
hours per week? 

Part-time (IF NONE, ENTER ZERO.) 

IF ZERO FOR asaai QUESTION 1 AND 2, ASK: Do you have any 
plans to hire a (name of occupation) within the next four 
years? 

yes 1 CONTINUE INTERVIEW WITH QUESTION 6. 

NO 2 THANK RESPONDENT AND END INTERVIEW. 
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3. Generally, what is the educational background of Mfit (name 
of occupation) in your firm? Is it best described as... READ 
CHOICES AND CIRCLE ONLY ONE. 

Less than high school 1 

High school diploiaa 2 

Technical college degree 3 

Soiae four-year college 4 

Bachelor's degree 5 

Graduate work ^ 

Other "7 

( Specify :^ ) 

4. Has the nuiaber of full-time (nr^e of occupation) at your 
firm increased, decreased or s-ayed the same over the past 
four years? How about part-time? CIRCLE ANSWER BELOW. 

Incr Deer Saiae Don't know 

a. Fiai-tioe 1 2 3 4 

b. Part-time 1 2 3 4 

*5. During the next four years, do you expect the number of 
full-time (name of occupation) at your firm to increase, 
decrease or stay the same? How about part-time? CIRCLE 
ANSWER BELOW. 

Incr Deer Same Don't Know 

a. Full-time 1 2 3 4 

b. Part-time 1 2 3 4 

*5a. IF INCREASE OR DECREASE: What do you think is the reason 
for the change? 



6. Considering new positions and positions due to turnover, how 
many openings for full-time (name of occupation) do you 
expect at your firm over the next four years? And how many 
part-ti'^ie? 

Full-time (IF NONE, ENTER ZERO) 

Part-time (IF NONE, ENTER ZERO) 

♦ Question not required to complete Section 7 Statistical 
Report 
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7. Do you ever have difficulties finding qualified (name of 
occupation ) ? 



Yes 1 

No 2 



8. In general, were your (name of occupation) well-trained when 
you hired then? 



Yes 1 

No 2 



*8a, IP NO; Why you say that? 



9. What is the typical starting hourly wage for a (name of 
occupation) in your firm? 



per hour 



READ PROGRAM CONCEPT STATEMENT: 



_^ — Technical College is looking into the possibility of 

offering a (name of occupation) Prograa. This (one or two)-year 
program would train people to perform (name of occupation) 
duties, such as ' 



. 

students would take courses in 
and 



10. Assuming you had an opening, would you be willing to hire a 
graduate of the (name of occupation) program if he or she 
had no previous work experience? 

Yes 1 

No 2 

Not sure 3 

*10a. Why do you say that? 



♦Question not required for Section 7 statistical Report. 
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11. would you encourage your present employees to participate in 
this program if offered at Technical College? 

yes 1 *IF YES: How many? 



No 2 *IF NO: Why do you say that? 



12 on a 1-4 scale, with 4 being very important and one being 

not at all important, how important a'^e «>^i^«i"2xn« n«nr 

factors when you hire a (name of occupation)? READ EACH ONE 

AND CIRCLE RATING. 

Very Not 
Import at all 

a) High school diploma or GED 4 3 2 1 

b) Previous work experience 4 3 2 1 

c) Special certification/license 4 3 2 1 

d) Technical college degree 4 3 2 1 

e) Four-year college degree 4 3 2 1 

f) Interpersonal skills 4 3 2 1 

g) Personal recommendation 4 3 2 1 

*13. Overall, what is the minimum level of education you feel 

would be sufficient to qualify a candidate to be hired as a 
(name of occupation)? READ CHOICES AND CIRCLE ONE ANSWER. 

High school diploma ^ 

One year technical college degree 2 

Two year technical college degree 3 

Some four-year college 4 

Bachelor's degree ^ 

Graduate work ^ 

Other ' 

( Specify :_^ ) 

♦14. If Technical College offered this program, would 

you be interested in serving on an employer advisory board? 

Yes 1 

No 2 

*15. How many employees does your organization have? 



♦Question not required for Section 7 Statistical Report 
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16. CODE RESPONDENT'S LOCATION 

In district 1 

Out of district 2 



FILL IN: 

RESPONDENT'S NAME 

POSITION 

FIRM 

ADDR2SS 

PHONE 



INTERVIEWER INITIALS 



DATE 



Appendix C 
Sample Cover Letter for Mail Opton 



Date 



XXXXXXXXXXXXYXXXXXXXX 

XXX xxxxxxxxxxx xxxxxxx 

XXXXXXXXXX, XX xxxxx 

Dear (Name of Respondent}: 

When our telephone interviewers contacted your office recently, they were told you would 
prefer to comfHete our sun^ey on the need for (name of occupation) by mail. Enclosed 
is the survey form. Although it is formatted for a telephone suivey. 1 think you will find 
it easy to fill out. 

Thank you very much for your partidpation in this sun/ey. Before the (name of 
occupation) training can be offered through (name of) Technical College, we must know 
whether there is substantial need for more (name of oocupation)s in our region. 

Your response is important to the success of our study. arKi we will look forward to 
hearing from you. 

Sincerely, 

(Name and Phone Number of Research Director) 



Enclosure 



Appendix D 

Sample Call Record Form 



Employer 


Result 


Call back 
#1 


Callback 
#2 


Callback 
#3 


Jones. Bill J. 
1721 N. Rankin St. 
Appleton,Wl 54911 
555-1214 










Smith, Nancy 
333 E. Wisconsin St. 
Appleton, Wl 54911 
555-2356 










Edwards, i^rry J. 
2830 Longview Dr. 
Appleton. Wl 54911 
555-1803 


O 


4 am 






James. Barbara M. 
323 E. Franklin St. 
Appleton. Wl 54911 


mud 








555-1110 


Codes ThmCem Be Used 
To Record Outcomes of Calls 




C 

Rem 

Ref 

CB 


Completed interview 
Remove from pool 
Refused interview 

Msdl out survey 


Npte: These forms can 
bB put into three-ring 
binders for interviewers. 











